Examining Motor Anticipation in Handwriting as an Indicator of Motor Dysfunction in Schizophrenia.

Dysfunction in motor skills can be linked to alterations in motor processing, such as the anticipation of forthcoming graphomotor sequences. We expected that the difficulties in motor processing in schizophrenia would be reflected in a decrease of motor anticipation. In handwriting, motor anticipation concerns the ability to write a letter while processing information on how to produce the following letters. It is essential for fast and smooth handwriting, that is, for the automation of graphomotor gestures. In this study, we examined motor anticipation by comparing the kinematic characteristics of the first l in the bigrams ll and ln written on a digitiser. Previous studies indicated that the downstroke duration of the first l is modulated by the anticipation of the local constraints of the following letter. Twenty-four adult individuals with diagnosis of schizophrenia and 24 healthy adults participated in the study. The classic measures of duration (sec), trajectory (cm), and dysfluency (velocity peaks) were used for the kinematic analysis of the upstroke (US) and downstroke (DS). In the control group, the duration of the downstroke of the l was longer in ln than ll (US: ln = ll; DS: ln > ll) whereas no differences were found for the group with schizophrenia. Likewise, the control group showed a longer DS trajectory for the l of ln than ll in downstrokes, while the group of patients failed to show this effect. These results suggest that the motor alterations in patients with schizophrenia could also affect their ability for motor anticipation.

The impact of spelling regularity on handwriting production: A coupled fMRI and kinematics study.

Current models of writing assume that the orthographic processes involved in spelling retrieval and the motor processes involved in the control of the hand are independent. This view has been challenged by behavioral studies, which showed that the linguistic features of words impact motor execution during handwriting. We designed an experiment coupling functional magnetic resonance imaging and kinematic recordings during a writing to dictation task. Participants wrote orthographically regular and irregular words. The presence of an irregularity impacts both the initiation of the movement and its fine motor execution. At the brain level, the left inferior frontal and fusiform gyri, two regions belonging to the core of the written language system, were found to be sensitive to the presence of an irregularity and to its position in the word during writing execution. Moreover, the left superior parietal lobule, the left superior frontal gyrus and the right cerebellum, three motor-related regions, displayed a stronger response to irregular than regular words. These results constitute direct evidence that orthographic and motor processes occur in a continuous and interactive fashion during writing.

Investigating how children produce rotation and pointing movements when they learn to write letters.

How do children learn to write letters? During writing acquisition, some letters may be more difficult to produce than others because certain movement sequences require more precise motor control (e.g., the rotation that produces curved lines like in letter O or the pointing movement to trace the horizontal bar of a T). Children of ages 6-10 (N = 108) wrote sequences of upper-case letters on a digitizer. They varied in the number of pointing and rotation movements. The data revealed that these movements required compensatory strategies in specific kinematic variables. For pointing movements there was a duration decrease that was compensated by an increase in in-air movement time. Rotation movements were produced with low maximal velocity but high minimal velocity. At all ages there was a global tendency to keep stability in the tempo of writing: pointing movements exhibited a duration trade-off whereas rotation movements required a trade-off on maximal and minimal velocity. The acquisition of letter writing took place between ages 6 and 7. At age 8 the children shifted focus to improving movement control. Writing automation was achieved around age 10 when the children controlled movement duration and fluency. This led to a significant increase in writing speed.

The Time Course of Audio-Visual Phoneme Identification: a High Temporal Resolution Study.

Speech unfolds in time and, as a consequence, its perception requires temporal integration. Yet, studies addressing audio-visual speech processing have often overlooked this temporal aspect. Here, we address the temporal course of audio-visual speech processing in a phoneme identification task using a Gating paradigm. We created disyllabic Spanish word-like utterances (e.g., /pafa/, /paθa/, …) from high-speed camera recordings. The stimuli differed only in the middle consonant (/f/, /θ/, /s/, /r/, /g/), which varied in visual and auditory saliency. As in classical Gating tasks, the utterances were presented in fragments of increasing length (gates), here in 10 ms steps, for identification and confidence ratings. We measured correct identification as a function of time (at each gate) for each critical consonant in audio, visual and audio-visual conditions, and computed the Identification Point and Recognition Point scores. The results revealed that audio-visual identification is a time-varying process that depends on the relative strength of each modality (i.e., saliency). In some cases, audio-visual identification followed the pattern of one dominant modality (either A or V), when that modality was very salient. In other cases, both modalities contributed to identification, hence resulting in audio-visual advantage or interference with respect to unimodal conditions. Both unimodal dominance and audio-visual interaction patterns may arise within the course of identification of the same utterance, at different times. The outcome of this study suggests that audio-visual speech integration models should take into account the time-varying nature of visual and auditory saliency.

The elaboration of motor programs for the automation of letter production.

We investigated how children learn to write letters. Letter writing evolves from stroke-by-stroke to whole-letter programming. Children of ages 6 to 9 (N=98) wrote letters of varying complexity on a digitizer. At ages 6 and 7 movement duration, dysfluency and trajectory increased with stroke number. This indicates that the motor program they activated mainly coded information on stroke production. Stroke number affected the older children's production much less, suggesting that they programmed stroke chunks or the whole letter. The fact that movement duration and dysfluency decreased from ages 6 to 8, and remained stable at ages 8 and 9 suggests that automation of letter writing begins at age 8. Automation seems to require the elaboration of stroke chunks and/or letter-sized motor programs.

The impact of developmental dyslexia and dysgraphia on movement production during word writing.

This study investigated how deficits in orthographic processing affect movement production during word writing. Children with dyslexia and dysgraphia wrote words and pseudo-words on a digitizer. The words were orthographically regular and irregular of varying frequency. The group analysis revealed that writing irregular words and pseudo-words increased movement duration and dysfluency. This indicates that the spelling processes were active while the children were writing the words. The impact of these spelling processes was stronger for the children with dyslexia and dysgraphia. The analysis of individual performance revealed that most dyslexic/dysgraphic children presented similar writing patterns. However, selective lexical processing deficits affected irregular word writing but not pseudo-word writing. Selective poor sublexical processing affected pseudo-word writing more than irregular word writing. This study suggests that the interaction between orthographic and motor processing constitutes an important cognitive load that may disrupt the graphic outcome of the children with dyslexia/dysgraphia.

Electrophysiological evidence for a self-processing advantage during audiovisual speech integration.

Previous electrophysiological studies have provided strong evidence for early multisensory integrative mechanisms during audiovisual speech perception. From these studies, one unanswered issue is whether hearing our own voice and seeing our own articulatory gestures facilitate speech perception, possibly through a better processing and integration of sensory inputs with our own sensory-motor knowledge. The present EEG study examined the impact of self-knowledge during the perception of auditory (A), visual (V) and audiovisual (AV) speech stimuli that were previously recorded from the participant or from a speaker he/she had never met. Audiovisual interactions were estimated by comparing N1 and P2 auditory evoked potentials during the bimodal condition (AV) with the sum of those observed in the unimodal conditions (A + V). In line with previous EEG studies, our results revealed an amplitude decrease of P2 auditory evoked potentials in AV compared to A + V conditions. Crucially, a temporal facilitation of N1 responses was observed during the visual perception of self speech movements compared to those of another speaker. This facilitation was negatively correlated with the saliency of visual stimuli. These results provide evidence for a temporal facilitation of the integration of auditory and visual speech signals when the visual situation involves our own speech gestures.

The Impact of Early Bilingualism on Face Recognition Processes.

Early linguistic experience has an impact on the way we decode audiovisual speech in face-to-face communication. The present study examined whether differences in visual speech decoding could be linked to a broader difference in face processing. To identify a phoneme we have to do an analysis of the speaker's face to focus on the relevant cues for speech decoding (e.g., locating the mouth with respect to the eyes). Face recognition processes were investigated through two classic effects in face recognition studies: the Other-Race Effect (ORE) and the Inversion Effect. Bilingual and monolingual participants did a face recognition task with Caucasian faces (own race), Chinese faces (other race), and cars that were presented in an Upright or Inverted position. The results revealed that monolinguals exhibited the classic ORE. Bilinguals did not. Overall, bilinguals were slower than monolinguals. These results suggest that bilinguals' face processing abilities differ from monolinguals'. Early exposure to more than one language may lead to a perceptual organization that goes beyond language processing and could extend to face analysis. We hypothesize that these differences could be due to the fact that bilinguals focus on different parts of the face than monolinguals, making them more efficient in other race face processing but slower. However, more studies using eye-tracking techniques are necessary to confirm this explanation.

Effects of grapheme-to-phoneme probability on writing durations.

The relative involvement of the lexical and sublexical routes across different writing tasks remains a controversial topic in the field of handwriting production research. The present article reports two experiments examining whether or not the probability of a grapheme-to-phoneme (G-P) mapping affected production during copy of polyvalent graphemes embedded in French (Exps. 1a and 1b) and Spanish (Exp. 2) known words. The relative probabilities of two different G-P mappings associated with the same polyvalent grapheme were manipulated (higher vs. lower probability). In Experiment 1a, we used the polyvalent French grapheme E. Writing durations revealed that the interletter intervals (ILIs) located before and after this letter were shorter and that the letter itself was executed faster in the condition of higher probability of the G-P mapping (e.g., S E RVICE, "service") than in the lower-probability condition (e.g., S E MAINE, "week"). In Experiment 1b, we used the sequence TI (e.g., VIC TI ME-MAR TI EN, "victim-Martian"), which is less frequent. In this case, we failed to observe significant differences between the conditions. In Experiment 2, effects similar to those obtained in Experiment 1a were found with Spanish words using different pronunciations of the letter C (e.g., DES C ANSO-DES C ENSO, "rest-descent"). Altogether, these results reveal that the link between a grapheme and a phoneme is weighted according to its probability in the language. Moreover, they suggest that a two-phase route linking graphemes to phonemes and phonemes to graphemes is functional during copy.

How does the interaction between spelling and motor processes build up during writing acquisition?

How do we recall a word's spelling? How do we produce the movements to form the letters of a word? Writing involves several processing levels. Surprisingly, researchers have focused either on spelling or motor production. However, these processes interact and cannot be studied separately. Spelling processes cascade into movement production. For example, in French, producing letters PAR in the orthographically irregular word PARFUM (perfume) delays motor production with respect to the same letters in the regular word PARDON (pardon). Orthographic regularity refers to the possibility of spelling a word correctly by applying the most frequent sound-letter conversion rules. The present study examined how the interaction between spelling and motor processing builds up during writing acquisition. French 8-10 year old children participated in the experiment. This is the age handwriting skills start to become automatic. The children wrote regular and irregular words that could be frequent or infrequent. They wrote on a digitizer so we could collect data on latency, movement duration and fluency. The results revealed that the interaction between spelling and motor processing was present already at age 8. It became more adult-like at ages 9 and 10. Before starting to write, processing irregular words took longer than regular words. This processing load spread into movement production. It increased writing duration and rendered the movements more dysfluent. Word frequency affected latencies and cascaded into production. It modulated writing duration but not movement fluency. Writing infrequent words took longer than frequent words. The data suggests that orthographic regularity has a stronger impact on writing than word frequency. They do not cascade in the same extent.

Bilingualism affects audiovisual phoneme identification.

We all go through a process of perceptual narrowing for phoneme identification. As we become experts in the languages we hear in our environment we lose the ability to identify phonemes that do not exist in our native phonological inventory. This research examined how linguistic experience-i.e., the exposure to a double phonological code during childhood-affects the visual processes involved in non-native phoneme identification in audiovisual speech perception. We conducted a phoneme identification experiment with bilingual and monolingual adult participants. It was an ABX task involving a Bengali dental-retroflex contrast that does not exist in any of the participants' languages. The phonemes were presented in audiovisual (AV) and audio-only (A) conditions. The results revealed that in the audio-only condition monolinguals and bilinguals had difficulties in discriminating the retroflex non-native phoneme. They were phonologically "deaf" and assimilated it to the dental phoneme that exists in their native languages. In the audiovisual presentation instead, both groups could overcome the phonological deafness for the retroflex non-native phoneme and identify both Bengali phonemes. However, monolinguals were more accurate and responded quicker than bilinguals. This suggests that bilinguals do not use the same processes as monolinguals to decode visual speech.

On the Links Among Face Processing, Language Processing, and Narrowing During Development.

From the beginning of life, face and language processing are crucial for establishing social communication. Studies on the development of systems for processing faces and language have yielded such similarities as perceptual narrowing across both domains. In this article, we review several functions of human communication, and then describe how the tools used to accomplish those functions are modified by perceptual narrowing. We conclude that narrowing is common to all forms of social communication. We argue that during evolution, social communication engaged different perceptual and cognitive systems-face, facial expression, gesture, vocalization, sound, and oral language-that emerged at different times. These systems are interactive and linked to some extent. In this framework, narrowing can be viewed as a way infants adapt to their native social group.

Impact of orthographic transparency on typical and atypical reading development: evidence in French-Spanish bilingual children.

The present study aimed to quantify cross-linguistic modulations of the contribution of phonemic awareness skills and visual attention span (VA Span) skills (number of visual elements that can be processed simultaneously) to reading speed and accuracy in 18 Spanish-French balanced bilingual children with and without developmental dyslexia. The children were administered two similar reading batteries in French and Spanish. The deficits of the dyslexic children in reading accuracy were mainly visible in their opaque orthography (French) whereas difficulties indexed by reading speed were observed in both their opaque and transparent orthographies. Dyslexic children did not exhibit any phonemic awareness problems in French or in Spanish, but showed poor VA Span skills compared to their control peers. VA span skills correlated with reading accuracy and speed measures in both Spanish and French, whereas phonemic awareness correlated with reading accuracy only. Overall, the present results show that the VA Span is tightly related to reading speed regardless of orthographic transparency, and that it accounts for differences in reading performance between good and poor readers across languages. The present findings further suggest that VA Span skills may play a particularly important role in building-up specific word knowledge which is critical for lexical reading strategies.

Dyslexia in a French-Spanish bilingual girl: behavioural and neural modulations following a visual attention span intervention.

We report the case study of a French-Spanish bilingual dyslexic girl, MP, who exhibited a severe visual attention (VA) span deficit but preserved phonological skills. Behavioural investigation showed a severe reduction of reading speed for both single items (words and pseudo-words) and texts in the two languages. However, performance was more affected in French than in Spanish. MP was administered an intensive VA span intervention programme. Pre-post intervention comparison revealed a positive effect of intervention on her VA span abilities. The intervention further transferred to reading. It primarily resulted in faster identification of the regular and irregular words in French. The effect of intervention was rather modest in Spanish that only showed a tendency for faster word reading. Text reading improved in the two languages with a stronger effect in French but pseudo-word reading did not improve in either French or Spanish. The overall results suggest that VA span intervention may primarily enhance the fast global reading procedure, with stronger effects in French than in Spanish. MP underwent two fMRI sessions to explore her brain activations before and after VA span training. Prior to the intervention, fMRI assessment showed that the striate and extrastriate visual cortices alone were activated but none of the regions typically involved in VA span. Post-training fMRI revealed increased activation of the superior and inferior parietal cortices. Comparison of pre- and post-training activations revealed significant activation increase of the superior parietal lobes (BA 7) bilaterally. Thus, we show that a specific VA span intervention not only modulates reading performance but further results in increased brain activity within the superior parietal lobes known to housing VA span abilities. Furthermore, positive effects of VA span intervention on reading suggest that the ability to process multiple visual elements simultaneously is one cause of successful reading acquisition.

How do we code the letters of a word when we have to write it? Investigating double letter representation in French.

How do we code the letters of a word when we have to write it? We examined whether the orthographic representations that the writing system activates have a specific coding for letters when these are doubled in a word. French participants wrote words on a digitizer. The word pairs shared the initial letters and differed on the presence of a double letter (e.g., LISSER/LISTER). The results on latencies, letter and inter-letter interval durations revealed that L and I are slower to write when followed by a doublet (SS) than when not (ST). Doublet processing constitutes a supplementary cognitive load that delays word production. This suggests that word representations code letter identity and quantity separately. The data also revealed that the central processes that are involved in spelling representation cascade into the peripheral processes that regulate movement execution.

The "BIG BIRD" of the "YELLOW YOUNG" man: do nontarget properties cascade?

This study investigated whether in speech production object properties flow in a cascaded manner or whether cascaded processing is restricted to the object's identity. In Experiments 1 and 2, participants saw pictured objects and had to state either their size (GRAND or PETIT-meaning big and small) or their name. The size of the objects varied as a function of the way they were presented on the computer screen (Experiment 1) or their real size in the world (Experiment 2). In Experiment 3, faces of young and old men were coloured in yellow or in green. The task was to name either the colour (JAUNE or VERT, meaning yellow and green, respectively) or the age (JEUNE or VIEUX, meaning young and old, respectively) of the face. In Experiments 1 and 2, no reliable effects of phonological relatedness ("GORILLE-grand"-a big gorilla) were found on the object-naming latencies. However, size-naming latencies were shorter when the adjective shared the initial phoneme of the picture name (i.e., "GRAND-gorille") than when it did not (i.e., "GRAND-dinosaure"-saying "big" in response to a big dinosaur). In Experiment 3, phonological overlap did not affect colour naming latencies, or age naming latencies. Overall, these findings strongly suggest that cascaded processing is restricted to the object's identity in conceptually driven naming tasks.

Further evidence for the interaction of central and peripheral processes: the impact of double letters in writing English words.

Most studies on spelling processes suppose that the activation of orthographic representations is over before we start to write. The goal of the present study was to provide evidence indicating that the orthographic representations activated during spelling production interact continuously with the motor processes during movement production. We manipulated gemination to assess the influence of the orthographic properties of words on the kinematic parameters of production. Native English-speaking participants wrote words containing double letters and control words on a digitizer [e.g., DISSIPATE (Geminate) and DISGRACE (Control)]. The word pairs shared the initial letters and differed on the presence of a doublet at the same position. The results revealed that latencies were shorter for Geminates than Controls, indicating that spelling processes were facilitated by the presence of a doublet in the word. Critically, the impact of letter doubling was also observed during production, with shorter letter durations (e.g., D, I, S) and intervals (DI, IS) for Geminates than Controls. Letter doubling therefore affected the whole process of word writing: from spelling recall to movement preparation and production. The spelling processes that were involved before movement initiation cascaded into processes that regulate movement execution. The activation spread onto peripheral processing until the production of the doublet was completely programmed (e.g., letter S).

The interaction between central and peripheral processes in handwriting production.

Written production studies investigating central processing have ignored research on the peripheral components of movement execution, and vice versa. This study attempts to integrate both approaches and provide evidence that central and peripheral processes interact during word production. French participants wrote regular words (e.g. FORME), irregular words (e.g. FEMME) and pseudo-words (e.g. FARNE) on a digitiser. Pseudo-words yielded longer latencies than regular words. Letter durations were greater for words at earlier letter positions and greater for pseudo-words at the later positions. Letter durations were longer for irregular than regular words. The effect was modulated by the position of the irregularity. These findings indicate that movement production can be affected by lexical and sublexical variables that regulate spelling processes. They suggest that central processing is not completely finished before movement initiation and affects peripheral writing mechanisms in a cascaded manner. Lexical and sublexical processing does not cascade to the same extent.

Processing prefixes and suffixes in handwriting production.

Previous research showed that handwriting production is mediated by linguistically oriented processing units such as syllables and graphemes. The goal of this study was to investigate whether French adults also activate another kind of unit that is more related to semantics than phonology, namely morphemes. Experiment 1 revealed that letter duration and inter-letter intervals were longer for suffixed words than for pseudo-suffixed words. These results suggest that the handwriting production system chunks the letter components of the root and suffix into morpheme-sized units. Experiment 2 compared the production of prefixed and pseudo-prefixed words. The results did not yield significant differences. This asymmetry between suffix and prefix processing has also been observed in other linguistic tasks. In suffixed words, the suffix would be processed on-line during the production of the root, in an analytic fashion. Prefixed words, in contrast, seem to be processed without decomposition, as pseudo-affixed words.